Sampling from a Gibbs measure with pair interaction by 

means of PCA 



Paolo Dai Pra 1 Benedetto Scoppola 2 Elisabetta Scoppola 3 

January 30, 2012 



1 Dipartimento di Matematica Pura ed Applicata, University of Padova 
Via Trieste 63, 35121 Padova, Italy 



. daipra@math.unipd.it 

Q-r 

2 Dipartimento di Matematica, University of Roma "Tor Vergata" 
Via della Ricerca Scientifica - 00133 Roma, Italy 
scoppolaOmat . uniroma2 . it 

3 Dipartimento di Matematica, University of Roma "Roma Tre" 
Largo San Murialdo, 1 - 00146 Roma, Italy 
scoppola@mat . uniroma3 . it 

Abstract 

We consider the problem of approximate sampling from the finite volume Gibbs 
measure with a general pair interaction. We exhibit a parallel dynamics (Probabilistic 
Cellular Automaton) which efficiently implements the sampling. In this dynamics the 
product measure that gives the new configuration in each site contains a term that 
tends to favour the original value of each spin. This is the main ingredient that allows 
to prove that the stationary distribution of the PCA is close in total variation to the 
Gibbs measure. The presence of the parameter that drives the "inertial" term men- 
tioned above gives the possibility to control the degree of parallelism of the numerical 
implementation of the dynamics. 
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1 Introduction 



Probabilistic Cellular Automata (PCA) are (time-homogeneous) discrete-time Markov 
Chains on a product space S , whose transition probability P(dcr|a"') is a product measure: 

P{a\a') = Hpi(dai\a'), 

where, for i G V and a' G S 1 , (rfcr^ |cr') is a probability on S. Compared with the more 
familiar sequential dynamics, where the transition probabilities P(da\a') are supported on 
configuration a with o~j = a'- for all but one j G V, PCA's exhibit the following peculiar 
features. 

• The parallel updating rule allow to exploit the efficiency of parallel computation in 
the simulation of these dynamics, making them desirable Markov Chain Monte Carlo 
algorithms. 

• PCA's give rise to well defined infinite volume dynamics (V infinite countable), 
without passing to continuous time. 
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The study of PCA's in the context of Equilibrium Statistical Mechanics dates back to 
I12j . where various features of the infinite- volume limit have been investigated, in particular 
its space-time Gibbsian nature. On the other hand, invariant measures for infinite-volume 
PCA's may be non-Gibbsian, as shown in [3]. 

In the context of Markov Chain Monte Carlo algorithms the following natural problem 
arise: given a probability fi on S v , construct a PC A whose invariant measure is /x; in 
particular, in the case fi is a Gibbs measure for a short range interaction, one expects 
that the transition probabilities of the PCA can be chosen to be local, i.e. pi(dai\a') 
depends only on a'- for j "close" to i. While Markov Chain with sequential dynamics 
having these features can always be constructed, the existence of a PCA with the given 
invariant measure [i is not granted. Counterexamples are given in [3], while [10] provides 
explicit conditions on \i for the existence of a PCA reversible with respect to /i. 

A well understood example is that of the 2d Ising model. By the results in [10] it 
follows that no PCA can be reversible with respect to the 2d Ising model. In [12] and [T] 
a PCA is introduced whose invariant (reversible) measure tt is related to the Ising model 
as follows: the projection of tt to the even sites, i.e. those £ with i+j even, 

coincides with the same projection of the Ising model, and the same holds for odd sites; 
however, under tt, spins at even sites are independent from spins at odd sites, unlike for 
the Ising model. 

When the nearest neighbor interaction of the Ising model is generalized to a general 
pair interaction, this simple structure is lost. In this paper, following the ideas introduced 
in [9], we present a simple way to modify and extend the PCA in [I], and use it to sample 
approximately from a Gibbs measure. Given a spin configuration a £ { — 1, 1} V , where V 
is a finite subset of 7L d , we start with a Hamiltonian of the form 




corresponding to the Gibbs measure 



vr G (cr) oc exp[-#(cr)]. 
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This Hamiltonian can be lifted to a Hamiltonian on 



({-1,1} V ) 2 , setting 



The measure 



fi 2 (cr,(T') oc exp[-#(<7, cr')] 



is such that the conditional measure 




is a product measure, and can therefore be taken as transition probability of a PCA, 
which turns out to be reversible for a probability ir PCA . The parameter q controls the 
average number of spin-flips in a single step of our dynamics. This is the analogous of the 
self-interaction considered in [2] to study metastability in the limit of zero temperature, 
but our regime and our goal are completely different. The parameter q acts as the brake 
of the dynamics: for large values of q the dynamics is very slow, nipping few spins at each 
time, tending to "freeze" the system in its configuration, while a dynamics with q = 
is for instance the case of pp. We want to show that for suitable choices of q we have a 
dynamics that is considerably faster than the usual single spin-flip dynamics, and tends 
to a stationary measure tt pca that can be shown to be very close to the Gibbs measure 



More precisely we prove in Theorem 1 1 . 2 1 that when the volume goes to infinity, \V\ — > 



this request is compatible with a choice of q such that the average number of spin-flips 
in a move, 5\V\, is large. In Section [2] we give the proof of this convergence for rather 
general two-body interactions. Given the generality of the model, convergence is proved 
under Dobrushin uniqueness conditions, which implies the minimal condition needed for 
our argument, namely a form of fast decay of correlations. For special models, such as 
ferromagnets in pure states (see [14j). we expect that this fast decay of correlations hold 
true also in the coexistence region, where Dobrushin uniqueness fails. 



7T 



G 



oo, the total variation distance between ir c and n goes to zero when q is such that 
the mean density of flipped spins, 5 := e~ 2q satisfies rirniyi_ > . 00 5 2 \V\ = 0. Note that 
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1.1 Definitions 

Given a finite volume V C Z d we consider the spin configurations a € { — 1,1}^ and define 



H(a) = - JijViVj (!) 

where (Jij)ij£z d * s a given infinite symmetric matrix satisfying 

sup \J{j\ = J < oo (2) 

i 

J 

For simplicity, the sum in (pQ) is supposed to range over i,j € V; in other words, boundary 
conditions are empty. More general boundary conditions could be treated with no diffi- 
culty. 

The Hamiltonian will be written equivalently 

H(a) = Y,k(<r)<n (3) 

iev 

where 

hi(a) = -^Jijcrj (4) 

3 

Then we can define the standard Gibbs measure as 
where 

Z G = Y,e- H{a \ w G (a) = e- H ^ (6) 

a 

A sampler from this Gibbs measure can be realized by defining a Markov chain defined on 
the state space {—1,1}^ with invariant measure tt g , following the usual ideas of Markov 
Chain Monte Carlo methods. A standard algorithm is the Gibbs sampler which at each 
integer time: 

- a site i 6 V is randomly chosen (with uniform distribution); 

- the configuration outside i is left unchanged; 

- the new spin at i is sampled from the conditional measure ir G ( ■ \(Ty\ uy) 



This is equivalent to define: 



pG 

cr.T 



1 eM"K j f _ i 

TFf e^^K+e-M^K a / — o 

1 - E, e y ^ if °- = r (7) 

, otherwise 



Different single spin flip dynamics can also be defined, for instance with Metropolis 
rates. On the other side we can define an alternative collective dynamics, that we will call 
PCA dynamics, in the following way. Define 



H(a, a') = ]T [hi(a)al + q(l - a^)] (8) 



where q > 0. The PCA dynamics is the Markov chain defined by the following transition 
probabilities 

P% A = e ~^~ 0) 

where 

Z a = ^e- H{a ' T) =w PCA (a) (10) 

T 

It is a standard task to show that the chain is reversible with respect to the measure 

PCA ( , J2r^ T) ™ PCA (°) ™ PCA (°) (m 

Note that -k pc turns out to be the marginal of the Gibbs measure on the space of 
pairs of configurations 

e -B(fr,r) 

M2(g,r) = zPCA ■ (12) 

Due to the definition ([8]) the transition probabilities of this Markov chain can be written 
as a product of the transition probability of each component a\ of the new configuration, 
as usual for PCAs: 

iev 

where 

zcosn(n,j(o") — qoi) 
Our goal is to show that, for a suitable choice of "moderately" large q: 
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- the invariant measure of the PC A tt pca is "close" to tt g ; 

- the PCA updates at each time step a large number of spins. 

In order to state precisely the results we obtain, we recall the total variation distance, 
or L\ distance, between tt g and ir PCA as 

h PCA ~ * G \\tv = \ £ W PCA (a) - ir G (a)\ (13) 

(J 

1.2 Results 

Before stating our main result, we make some remarks on the relation between ir G and 
tt pca . Note first of all that 



w PCA 



r CT ) = ^g-Ei 6V [' 1 iW T ".+9(l-T.T 1 )] _ e -E ie iA/ii(o-)o- i +2j] Ig/ h ! ((T)(T l -2g|7| _ 
T ICV 

! (a)n(i+^) (14) 



iev 



where 5 = e 2q and 



We will call 



It easily follows that 



f(a) = H(l + 6<f> i ). (15) 
iev 



n PCA (a)=7vG{a) f (16) 
TT U {f) 



We also define the probability n by 



ll 



Theorem 1.1 For any q > let 5 := e 2<? . Suppose: 
(a) S = 5(\V\) is such that ]im\ v \^ > . 00 5 2 \V\ = 0; 
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(b) there exists 5q > such that 



sup sup — Varir 
v <5e[o,<5 ] I v I 



< oo 



(18) 



/or 7T = 7T 



and 7T = 7T. 



Then 



lim I Ivr 

|v|-k» 



PCA 



— vr \\tv = 0. 



(19) 



Condition( [T9|) follows by controlling the decay of correlations of the family of functions 
{4>i}. This control can be achieved by using the Dobrishin uniqueness condition. More 
precisely, we obtain the following result. 

Proposition 1.2 Assume 



Then assumption (b) in Theorem \l.l\ holds. 

1.3 Discussion and open problems 

1- Low temperature 

Hypothesis (|20p is the Dobrushin condition for uniqueness of phase for the Gibbs 
measure ir G . It is needed due to the generality of the interaction we are considering. 
Since the crucial ingredient in the proof of the Theorem is the correlation decay, 
we expect that hypothesis (|20p can be weakened if additional assumptions on the 
interaction are considered. This will be discussed in a forthcoming paper. 

In the last part of this paper we discuss in detail the Curie Weiss model. In the 
uniqueness region we show that (|19p hold with the condition limiyi^oo 5 = 0, much 
weaker than condition (a) in Theorem II . 1 1 while lrmiyi.^ 5 2 \V\ = suffices also 
at low temperature for a modified dynamics which is forced to select configurations 
with positive magnetization. 

2- Convergence to equilibrium of PCA 

Note that when 5 = the PCA dynamics is essentially equivalent to sequential 
Gibbs sampler, since the average number of spins that are updated in a time step 
is of order 5\V\. A natural question is then to compare the speed of convergence to 




(20) 



3 
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equilibrium of the PCA dynamics for ^ <C 5 <C ^= vs single spin flip dynamics. 
This is of course a central problem in applications. A quantitative comparison of the 
two dynamics is beyond the purposes of this paper. Our aim is rather to understand 
to what extent sampling of Gibbs measures can be implemented by parallel dynamics. 

3- Applications 

The PCA dynamics discussed in this paper has been introduced in [9] in order to 
study the clique problem on large graphs. In that case the general setup was more 
complicated since the canonical ensemble was considered. The excellent numerical 
results obtained for the clique problem, encouraged us to better undersatnd the PCA 
dynamics. In [6] a phase transition in the case of random graphs was proved. In 
general the extension of the result of this paper to the canonical ensemble is an 
interesting problem, and is currently under investigation. 



2 Proofs 



2.1 Proof of Theorem [TTT1 



Using (fill. (1151) and (1TB1). we have 



\^PCA Gu 
7T — 7T \\TV 



E 



w G (a) 



7T PCA (a) 



7T G (<t) 



E 



w u (a) 



w PCA (a) Z G 



w G {a) Z PCA 



E 



vr G (/) 



7T 



G 



vr G (/) 



< 



var 



(f)) 1/2 



7T G (/) 



(21) 



Therefore we need an estimate on the dependence on 5 of the quantity 



KG(f 2 ) 



(22) 



More precisely, we want to show that 



^lnvr G (/ 2 )-Al n ^ (/) = 0(j2) 



(23) 



Note first that, writing 



f(a) = exp 



£log(l + <%(*)) 



(24) 



9 



we have 



and 



+ 



^i„ g ^[/] = -^ 



St 



+ 



+ Var^pcA 



+ 



(25) 



(26) 



where we have used (fT6|) . Analogously, using (fTT|) . we have 



logvr G [/ 2 ] = 2tt 



d<5 



+ 



and 



d?6 



logvr G [/ 2 ] = -2tt 



£ if 



Sr 



+ 



(27) 



(28) 



The idea is to exploit this explicit results in order to control up to the second order an 
expansion of (]23p around 5 = 0. Clearly the first order computed in 5 = exhibit an 
explicit cancellation, since for 5 = we have that ir G = tt pca = jr. In order to show ([23 p. 
therefore, it is enough to prove that 



sup sup 



1 

TvT 



d 2 5 



logvr G [/] 



+ 



d?5 



logvr G [/ 21 



< +oo, 



which, by $2SD and ((SEJ) , follows from (fT8|) . 
□ 

2.2 Follmer's estimate 

Let 7T be a probability of { — 1, l} zd , and denote by ir (<Tj|<j\j) its local specifications. Define, 
for i ^ j, the Dobrushin coefficients: 



jij = sup 



|cr\j) - 7T ^CTj = 1|<7^. 



Assume the so-called Dobrushin uniqueness condition: 



7 : = SUP^Z 7 ^' < L 



(29) 
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Denoting by V the matrix with elements jij, under (I29D the matrix 

+00 

n=0 

is well defined. For a function / : — 1, l zd — > R, set 

/>;(/) :=sup|/(a)-/(^)|. 

The following is the main result of the beautiful paper [5] by H. Follmer (se also [11] for 
related results). 

Theorem 2.1 

\Cov n (f,g)\ <\Y,DijfH(f)Pi(g)- ( 3 °) 

2.3 Proof of Proposition 11.21 

We begin by showing that, under (|20|) . the Dobrushin Uniqueness condition hold for ir PCA 
and tt, for 5 sufficiently small. 

Proposition 2.2 Let 74,- 6e i/ie Dobrushin coefficients for tt pca (resp. tt). Then 

7i,j < tanh(2 I Jjjl) + -pj(ipi,s), 

where ip^g is defined by 

2 <M-) = ^ T+fc2W" + g ^ 1 + ^2^-2^)] 



Proof. The proof consists in a rather direct and straightforward computation. We 
give the proof for tt = tt pca . The proof for tt is similar. Set, for simplicity, i = 0. We 
write 

Hi := log(l + <5&), 
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so that 



7T (a) 



ZPCA 



cxp 



hi 



Note that 



^ Ji,j<Ti&j = -2cr h (a) + Ci(<t\ ), 



where, with Ci(a\p) we denote all remaining terms which do not depend on gq. Similarly 
Ho(*) = log (1 + 6e-*>° h ^) = -a log + + C 3 (o\o), 



and, for I ^ 0, 



H,(<7) = log (l + 5e~ 2ai ^ = log (1 + 5exp[-2J Qil a ai - 2<x^ 0) ^)]) 

1 (1 + 5exp[-2J iai - 2aih ,i(a)]) , „, , 

n^O log , r __._ r „ T „_ L + C 3\ a \0)- 



It follows that 



n PCA (a = 1\*\ ) 



(1 + 5 exp[2J 0t iai - 2aih 0t i(cr)]) 

exp [-2h (a) + ^(cr)] 



2cosh(2/i (o-) - ^(cr))' 



Now, writing ip$ for ^0 5) we have 



-2M<r) + ^) " (-2/io(^) + ^(^)) = 4J 0j - + i> 5 {<j) - M<? j )- 



Setting x := 2ho(a) — ips(cr) and y := 4Jqj + V^l ") — i'si® 3 )-, we have 



7T P ^(a = lKo) - n^ A (a = l\a{ ) 



PC A, 



-x-y 



\° 2cosh(:c) 2cosh(x + y) 



=: g y {x). 



Unless y = (which gives g y = 0), the derivative (fl^)' vanishes only at x = —y/2, where 
g 2 attains its absolute maximum tanh 2 (y/2). This yields 



vr FC Vo = lk\o) " ir° A (<ro = V\ ) < tanh ( 2J 0j + - \^ & [a) - M<? 3 ) 



Since, for every a, b > 0, tanh(a + b) < tanh(a) + 6, the conclusion of the lemma follows. 
□ 
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To complete the proof that the Dobrushin Uniqueness condition hold for ir PCA and tt, 
for 5 sufficiently small, it is enough to show the following result. 



Lemma 2.3 We have 



as S — > 0. 



sup^PjO/v) = o{6). 



Proof. Set i = and Vo,<5 = ^8- The estimate for a generic i is similar. Ignoring an 
irrelevant factor 2 



/ , \ . (. 1 + 8e- 2ho ^ \ / 1 + <5exp[-2J 0j a,- - 2ct,/i ,, (cj)] 
Pi^) < Pi log - ■ -3^-73 + Pi log 



1 + J^M") 



1 + 5 exp[2JojCTj — 2<Tj/io,i((T)] 



v-^ / 1 + 5 exp[-2J 0i ;O7 - 2o-;/l 0; f(c7)] ' 
^/ J V 0g l + 5exp[2J ^-2^V(^)] /' 

The main difficulty comes from the third term, and we only deal with it, i.e. we show that 



(^ 1 + <5exp[-2J 0j ;Cr; - 2(Jih i{(j)]\ 

2^ Z_> Pi [ l0 § 1 I r--rn T n.i. / _M ) = 

3 ¥0,j V 



+ 5 exp[2 J jai - 2oih Q j(o) 



Set 



\ , 1 + 5 exp[-2 J jai - 2aih 0>l (a)] ( sinh(2 \m) enp[-2aih i(a)} 

Ci(a) : = log — — 



+ 5exp[2J jai - 2aih j(a)] 



1 + 5 exp[2J 0tl ai - 2aih 0tl (a)] 



It is not restrictive to assume that 5 is small so that 

^ sinh(2 | Jjyj) exp[-2aih 0t i(a)] 1 
1 + 5 exp[2J 0ii cr/ - 2c7 Z /i ,/((t)] 2 ' 

Since, on (—1/2, 1/2) the map x \— > log(l — x) has Lipschitz constant 2, we have 



\Q{a) - d{^)\ <4<5sinh(2|J 0)I |) 



-2aih i(<ji) 



-2aih 0t i(a) 



1 _)_ § e 2Jo,l<ri-2crih ,i(a3) l _|_ ^ e 2J ,;o-;-2o-;ho,i(o") 



< 4<5 2 e 2J sinh(2|J ( 



e -2o- i h j(o-J) _ e -2o- i /i 0ji (o-) 



< 4<5 2 e 4J sinh(2|J (y |) " M*)| < 45 2 e 6J | ^11^1, 
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where we have used the estimates e 2J( M <T!_2CTi V i ( <TJ) < 2 J, sinh(2| J ,i|) < 
follows that 

£|> l lQ6 1 + *exp[2J ^ - 2a,M*)] J ~ ^ 6 l^'^'J 



Proof of Proposition For 7r = 7T or 7r = tt we have, by Theorem 12, H 



■Var n 



+ 



\v\ S 



1 + % ' 1 + 



1 



1 1 i,j£V h,k 



Pk 



V 1 + Hj . 

Since the map x i-> has Lipschitz constant 1 on [0, +oo), we have that 



Ph 



< Ph{4>i)- 



Moreover, it is easily seen that 



Therefore, since 



Ph{(t>i) < e 2J \Ji,h\- 



sup 



i P £(r*%< 



which implies 



we get 



sup Y] \D hk \ < —— , 



W\ Var * 



+ 



i,j€V h,k€V 



1 1 h,k 



2 e 4J , 



which completes the proof of Proposition 11.21 
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Remark 2.4 The control of the total variation distance between tt g and ir PCA by 

sup -^—Var^pcA 
<5e[0,<5 ] \ V \ 



l + 



(31) 



may be useful even if the above quantity diverges as \ V\ — > +oo. For instance, for the one 
dimensional model with 

J Jl 



% i3 ' I ' '19 > 

it is known the existence of an intermediate phase for which the spin-spin correlations 
decay as \i — j\~ 2+e , for some e S (0,2] (see JEJj). Assuming that a similar decay hold for 
the correlations of the ipi 's, the quantity in \31}) is expected to behave as \V\ £ as \ V\ f +oo. 
Thus, for Theorem to hold, we need 

lim 5 2 \V\ l+£ = Q 

|V|t+oo 

that, for e < 1, still allow 5\V\ —> +oo, i.e. a large number of spin updates per step. 

3 The mean field Ising model 

As an example we discuss the performances of the PCA dynamics for the mean-field Ising 
model, or Curie-Weiss model. In this section some computations are given only at a 
heuristic level. The rigorous treatment would be straightforward but rather lengthy. 

3.1 Distance between n PCA and n G and comparison of phase diagrams 

We consider now the following mean field hamiltonian on X := {— 1, +l}i 1, " ,n J 

Hcw{°) = -^~^2 a i a j ( 32 ) 



I.J 



and the corrisponding pair hamiltonian 



H CW (cr, o-') =-7rYl a i G 'i + " a ^'i) ( 33 ) 



2n 

1 j 
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By using the definitions m = m(a) = ^ Y2i a ii we can study the mean field model in the 
standard way. Indeed we have immediately 

Hcw(cr) = -^nm 2 

so that 

g7iF(m)+o(n) 



7T 



( m ):= 7rG ( £J )" z g 

a: m(a)=m 



with 



F(m) = -^ m2 + I( — — )) H x ) := —xlnx — (1 — x) ln(l — x). 



The small remainder o{n) is such that — >■ uniformly for |m| < 1 — e for any fixed 
e. The contribution of the magnetizations close to ±1 can be shown to be negligible. 
Moreover 

where m* := argmaxF(m) satisfies the standard condition for the Curie- Weiss model: 

T * 1, 1 + m* 
Jm = - in 



2 1 - m* 

obtaining m* = for J < 1 while for J > 1 the solutions = —m*_ can be obtained 
graphically. 

With an immediate computation we get for the function / defined in (|15p : 

^ m-|-l ^ 1 — m 

/( m ) = (l + <5e- Jm ) 2 (l + 5e Jm ) 2 =: e n9< - m ^ (34) 

with 

. a + b a — b 
g{m,5) := — hm— 

with 

a = o(m, 5) := ln(l + <5 e - Jm ), 6 = b(m, 5) := ln(l + Se Jm ) 

The function ff(m) = g(rn, 5) as a function of m, is a C°° function with the following 
properties: 

g(0) = ln(l + 5), g'(0) = 0, g"(0) = -SJ(1 - J) 
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g (m) = — 5m J cosh( Jm) + <5(J — 1) sinh( Jm) + o(5) 



(35) 



g(-m) = #(m). 

By defining m := argmax F(m) + Sg(m) we have that the measure tt pca is concen- 
trated on the configurations with magnetization m. 

In the case J < 1 it is immediate to verify that m = m* = 0. Recalling that 



F(m) = F(0) 



1 - J 



m 2 + o(m 2 ), 



the probability measures ir G and ir PCA can be estimated by Gaussian distributions cen- 
tered in with variances [n(l — J)]" 1 and [n(l — J — <5J(1 — J))]" 1 respectively. Therefore 
we can compute explicitly 

/M =e "toH-,(0)) (1+ 



yielding, for small <5 and large n, 



7T G (/ 2 ) 
(VT G (/)) 5 



E 



D nF(m) 



f(m) 



f(m) 



Z G 7T G (f) 



vr G (/) 



-nSJ(l-J)m 2 /2 



n{l - J- 5J(1 - J)) 
2^ 



VT G (/) 

dme -n{l-J-SJ(l-J))m 2 /2 L-nSJ(l-.J)m 2 /2 _ j 



Hence we obtain in this case a result stronger than Theorem 11.21 since we do not need 
the hypothesis 5 2 n — > 0, being enough that 5 — > as n — > oo. 

In the low temperature case J > 1 , for any finite J (temperature strictly positive), 
again we obtain the convergence result when 5 2 n — > 0, if the system is restricted to a 
single phase. Prom the dynamical point of view the restriction to a single phase can be 
obtained simply by a reflecting barrier, following for instance [13]. Consider the dynamics 
on X + := {a : m{a) > 0} obtained by generating a candidate move a' £ X according to 
([9]) with the pair hamiltonian (j33|) , and accepting it as a new state if a' G X+ and adopting 
— a' as new state if a' obtaining in this way for cr, a' S X + a transition probability 



P+(a, a') = P PCA (a, a') + P PCA (a, -a' 
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This dynamics on is reversible w.r.t. the invariant mesaure restricted to X + : for each 
a, a' E X + 



7r PCA \ x+ (a)P+(a,a>) 



7T PCA (X + ) 



P p G A (a 1 a , ) + P PCA {a,-O f 



n PCA (a') 



P {a,a) + P {-a ,a) = ir \x+{v )P 



->PCAr I 



r PCA\ (JW+IJ 



n PCA (X+ 

where we used the fact that ir p (a 7 ) = tt (— a'). Moreover with the same argument 
used in the high temperature case, we obtain \m* — fh\ = 0{5) and 



nF(m) 



f(m) 



Z G TrG(f) 



1 



TT 



PC A 



(m) 



ji{g{m)-g{m*)) _ ^ 



Ji[g(m)-g(rn*)} _ ^ ^ e ng'{m*)(m-m*) _ ^ _ Q(^ n \ 



where we used the fact that g'{m) = 0(S) (see (f35|) ). 



3.2 Convergence to equilibrium 

We give an estimate of the mixing time of the PCA for high temperature (J < 1) using 
a classical coupling argument. We first recall that the transition probabilities of the PCA 
obey the following identity: 



2 cosh(( Jm(a) + qat 



(36) 



Given two configurations a + and o~ we will write a + >z &~ if &f > &i V i G V. 
We will define a coupling of the transition probabilities P(cr' + \a + ) and -P(<7'~|(7 _ ) in the 
following way: we extract for each site i E V an independent random variable Ui uniformly 
distributed in [0,1]. Then, using the same random variable for both realizations of our 
PCA we say that a'f 1 = —1 if Uj < Pier'; = — 1 1 cr^ ) and a'f 1 = +1 otherwise. It is 
immediate to see that this updating rule gives a marginal distribution for both a' + and 
a'~ which is the original distribution of our PCA chain, and that if a + >z a" then also 
cr' + y a'~ . If we now denote with n^iff = ^(m + — m~) the number of sites i G V such 
that of > a~ , and with n' diS the number of sites i G V such that a'^ > a'~ , using ([361) 
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and the coupling rule we have that 

n ( e -Jm+-2q 

EKml^) = -(m+-m-) 1- - ■ _ 1 + 



2 \ 1 + e~ J m+ —2q Y -\- g-Jm — 2g I 

n I e -JmT-2q e -Jm + -2q \ 

+ 2 (1 + m ' ] [ l + e-Jm-a, ~ 1 + e Jm + -2 9 j ( 37 ) 
+ -(l-m + 



2 V 1 + g-^ m_ — 2g 1 + e^ m+ "^9 / 

This can be written, up to the first order in e~ 2q = 5, as 

^'( n diffl cr= ' : ) = n diff ~~ n5(m + cosh Jm + — m~ cosh Jm~ — sinh Jm + + sinh Jm~) + 0(5 2 ) 

(38) 

Using now the fact that 

sinh Jm^ < Jrri^ cosh Jm^ 

we have that 

E(n' diB \a ± ) < n diS - n5^—^-(Jm + cosh Jm + - sinh JmT) + 0(<5 2 ) (39) 
and by the inequality 

Jm + cosh Jm + — sinh Jm~ > J(m + — m~) 

we obtain finally 

SKffl^) < n diff (l - 25(1 - J) + 0(5 2 )) (40) 

Consider now the coupling applied to two copies of the PCA starting with spins all +1 
and —1 respectively. When J < 1, (|40p shows that E(n d is(t)) contracts exponentially in 
t. Denoting by r c the coalescing time of the two chains, we have 

P(t c >t)< P(n diS (t) / 0) < E(n diS (t)) < 2n [1 - 25(1 - J)]' 

By monotonicity, the total variation distance from equilibrium at time t of a PCA chain 
starting from an arbitrary configuration is bounded above by P(r c > t). This implies that 
the mixing time T m i x is of order rffng • 
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